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Abstract 

The CR manifold M m = {Imz 2 = [Rezi] 2m }(m = 2, 3, . . .) is the 
counterexample, which has been given by M. Christ and D. Geller, 
to analytic hypoellipticity of db and real analyticity of the Szego ker- 
nel. In order to give a direct interpretation for the breakdown of real 
analyticity of the Szego kernel, we give a Borel summation type rep- 
resentation of the Szego kernel in terms of simple singular solutions of 
the equation d^u = 0. 
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Introduction 



In [10], M. Christ and D. Geller gave the following remarkable counterex- 
ample to analytic hypoellipticity of db for real analytic CR manifolds of finite 
type (in the sense of Kohn [26] or D'Angelo [12]): 

THEOREM 0.1 On the three-dimensional CR manifold M m := {lmz 2 = [Rezi] 2 " 1 } 
(m — 2, 3, . . .), db fails to be analytic hypoelliptic (in the modified sense of 
[10]). 

Moreover analytic hypoellipticity of db is closely connected with real ana- 
lyticity of the Szego kernel off the diagonal. By considering the Szego kernel 
as a singular solution of the equation BbU = 0, Christ and Geller obtained 
Theorem 0.1 as a corollary to the following theorem. 

Theorem 0.2 The Szego kernel of M m (m=2, 3, . . .) fails to be real analytic 
off the diagonal. 

The proof of Theorem 0.2 by Christ and Geller [10] is based on certain 
formulas of A. Nagel [30]. Though their proof is logically clear, it seems dif- 
ficult to understand the singularity of the Szego kernel of M m directly, since 
their proof was established by contradiction. On the other hand, M. Christ 
([6], [7]) directly constructed singular solutions of dbU = and proved Theo- 
rem 0.1. In this paper, we give an integral representation of the Szego kernel 
of M m in terms of the singular solutions of Christ. Since the singular solu- 
tions of Christ are substantially simpler, our integral representation makes it 
easy to understand the singularity of the Szego kernel of M m . Moreover we 
give the direct proof of Theorem 0.2. We also give a similar representation 
of the Bergman kernel of the domain {Im^ > [Re^i] 2 " 1 } C C 2 (m = 2, 3, . . .) 
on the boundary. 

We remark that our subject in this paper has also been treated in the 
paper of M. Christ ([7], §7), and that our result can be considered as an 
improvement of Proposition 7.2 in [7]. 

In general we consider the hypersurface 

M P := {lmz 2 = P( Zl )} C C 2 , 

where P : C — > R is a real analytic function. We assume that AP is non- 
negative and does not vanish identically. Such a surface is pseudoconvex 
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and of finite type. A nonvanishing, antiholomorphic, tangent vector field is 
d/dzi — 2i(dP/dzi)d/dz 2 . As coordinates for the surface we use C x R 3 
(z = x + iy,t) i— > (z,t + iP(z)); the vector field pulls back to d b = d/dz — 
i(dP/dz)d/dt. Let <9£ denote the formal adjoint of df, with respect to the 
Lebesgue measure on C x R. We say that dj, is analytic hypoelliptic on Mp 
{in the modified sense of [10]) if whenever d^u is real analytic in an open set 
U and u = d£v for some v G L 2 in U, u is real analytic in U. In the usual 
sense, <9& is not even C°° hypoelliptic, but it is known that if dbd^u G C°°, 
then Blu G C°°([27]). 

Let S((z,t); (w,s)) be the Szego kernel of Mp; that is, the distribution 
kernel associated to the operator defined by the orthogonal projection of 
L 2 (C x R), with respect to the Lebesgue measure, onto the kernel of db- It 
is known that the Szego kernel is C°° off the diagonal ([31], [32]). 

There are many interesting studies on real analyticity for db and Szego 
kernels. For certain strictly pseudoconvex CR manifolds Mp (i.e. AP > 0), 
db is analytic hypoelliptic ([17]) and the Szego kernel is real analytic off the 
diagonal ([22]). In the weakly pseudoconvex case, there are many important 
results (see the references in [10]), but the precise condition for them to be 
real analyticity is still unknown. 

In investigating the properties of Szego kernels, it is an important prob- 
lem to find a good expression for them. For some classes of CR manifolds, 
the Szego kernels (or the Bergman kernels for some domains) are explic- 
itly computed in closed form ([19], [11], [13], [16], [21]). But the Szego kernels 
for almost all CR manifolds cannot be written in closed form. We consider 
the following two types of the integral representation for the Szego kernels. 
They are very useful to analyse the singularities of the Szego kernel (e.g. 
[3],[10],[20],[16],[24]). 

The representations of first type were obtained in [18], [29], [28], [30], [21]. 
For example, the Szego kernel of M P (P satisfies certain conditions) can be 
represented as follows (see [21]): 

r exp(r(rj(z+w) — P(z) — P(w) — i(s— t))) 

joo dndr. 

I exp(2r(rr] — P{r)))dr 

J — oo 

The representations of this type can be obtained by using the generalized 
Paley- Wiener theorem. Those of second type are represented as the Borel 
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(or Mittag-Leffler) summation of some countably many functions. For ex- 
ample, Bonami and Lohoue [3] gave the representation for the Szego kernel 

of{E™=iM 2mj = i}KeN): 



roo 

S(z, w) = c e 
Jo 



11 r(±L + J-\ 

j=lVj=0 Vm,- TO;' 



v n -i 1 



In this paper, we give a representation of the Borel summation type for the 
Szego kernel of M m by using the representation of first type, which is obtained 
by Nagel ([30]). Since the Szego kernel is expressed by the superposition of 
certain simple singular solutions of d^u = due to M. Christ, the structure 
of the singularity can be understood directly. The singularity of the Szego 
kernel is almost equal to that of Christ's singular solution involving the first 
eigenfunction of the certain ordinary differential operator (see §6). 

In this paper, we analyse the counterexample of Christ and Geller directly 
by using the classical asymptotic analysis for ordinary differential equations 
with irregular singular points. In particular, some techniques to obtain the 
asymptotic expansion of the functions admitting an integral representation 
or a Taylor series expansion are very useful for our computation ([14], [36]). 
Explicitly the properties of the entire function: 



J —oo 



play an important role in the breakdown of real analyticity, so we must obtain 
the detailed informations of ip. The properties of the function p are studied 
in [25] in detail. The function <p satisfies the ordinary differential equation 
of higher order: 

^2m- 1 2 2m ~ 2 

, 2m _! v x v = o. 

The above equation is a particular form of so-called Turrittin's equation, 
which has been studied by many authors (see the references in [25]). 

The plan of this paper is as follows. We state our results and outline of 
the proofs in Section I. In Section 2, we recall the direct construction of the 
singular solutions of d^u = in [6], [7], which are used in our representations. 
In Section 3, we establish our theorems. In Sections 4,5, we give the proofs 
of propositions and lemmas respectively, which are necessary for the proofs 
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of our theorems. In Section 6, we show the failure of real analyticity of the 
Szego kernel directly by using our representation. In Section 7, we study 
the boundary behaviors of the Szego and Bergman kernels of the domain 
{Im^x > [Rezi] 2m }(m = 2, 3, . . .) on the diagonal. 

In this paper, we use c or C (C(X 1 ,X 2 , ■ ■ •)) for various constants (de- 
pending on Xi, X 2 , ■ ■ •) without further comment. 

1 Statement of main results 

For M m = {lmz 2 = [Rez 1 ] 2m } (m = 2, 3, . . .), M. Christ in [6], [7] constructed 
the singular solutions of the equation d b u — (u — d£v,v G L 2 ) by applying 
the partial Fourier transformation and by solving a certain simple ordinary 
differential equation (see §2). 

Let (p(x) be the function defined by 

<p(x) = f°° e-^-^dw. 

J —oo 

Then it is known that if has infinitely many simple zeros and that all of them 
exist on the imaginary axis ([33]). We denote them by ±iaj (j G N), where 
the a/s are positive and arranged in the increasing order. (More detailed 
information of (p is explained in Section 3.) 
Christ's solutions are of the following form: 

roc „ l 

(1.1) S](z,t) = J o e itT e- x m T e *(y)ia ]Z T^ T v dT ( y ^ Q j eN}V y o), 

where z = x + iy and a(y) is the sign of y. It is easy to check that the S'J's 
are not real analytic on {(0 + iy, 0); y G R}. Besides this, the SJ's, off the set 
{y = 0}, belong to sth order Gevrey class G s for all s > 2m, but no better, 
where G s := {/; 3C > s.t. \d a f\ < C^T(s\a\) Va}. 

For M m (m = 2,3, . . .), define the distribution K(z,t) = S((z,t); (0,0)). 
Then K is a C°° function away from (0,0) ([31], [32]). We give a representa- 
tion of K in terms of the singular solutions {SJjjeN. 

Theorem 1.1 //|argz±!| < ^hih then 

roo 

(1.2) K(z,t) = c s e- p H(z,t;p)dp, 

Jo 
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where 

OO j 

(1.3) H(z,t;p) = J2c J Sf(z,t)p^\ 

3=1 

for some sequence f(j) = j + jo + 0(j~ r )(> 0) as j — > oo and c s 7 c,- 's 
and jo ^ Z are constants. Moreover there exists a positive constant C s (z) 
depending on z such that, 

(1.4) |#0M;p)| <C 5 (z)|p|-i. 

Let B((zi, Z2); (wi, W2)) be the Bergman kernel of the domain D— {Im^2 > 
P(z\)} C C 2 ; that is, the distribution kernel for the orthogonal projec- 
tion of L 2 (D) onto the subspace of holomorphic functions. Then B ex- 
tends to a C°° function on D x D minus the diagonal ([31], [32]). When 
D = D rn := {Im^ > [Re^i] 2 ™} (m = 2, 3, . . .), we obtain a similar representa- 
tion of K B (z,t):=B((z,t + ix 2m ); (0,0)). 

Theorem 1.2 7/|argz±f| < ^rrf; ^ eri 

(1.5) K B (z,t) = c B e- p H B (z,t;p)dp, 

Jo 

with 

00 j 

(1.6) ^(z,^)^^™^^), 

j'=i 

where Cj's and f(j) are as in Theorem 1.1 and c B is a constant. Moreover 
there exists a positive constant C B (z) depending on z such that, 

(1.7) \H B (z,t;p)\<C B (z)\p\-*. 

Remarks. 1) The constants c/s in (1.3), (1.6) are given as follows: 



1 1 

tp'iiaj) F(f(j) + 1) 



2) We believe that j and 0(j~ l ) in the above theorems are removable, 
that is, f(j) can be replaced by j. We do not know whether the order — | in 
(1.4), (1.7) is optimal. 
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3) If we change the order of the sum and the integral in (1.2), (1.5) 
formally, we obtain the formal sum of the form Y^jLidjSj(z,t), where d/s 
are constants. However the formal sum is not convergent in the usual sense. 
We shall show this fact in Subsection 5.6. 

Outline of the proofs. We explain the idea of the proof of Theorem 
1.1 roughly. The proof of Theorem 1.2 is given in the same fashion. 

Our computation starts from the following formula which has been ob- 
tained by A. Nagel 



1. 



K(z,t) 



e itT e 



1 



ip(v) 



dv 



r^-dr. 



As mentioned above, the function ip has countably many zeros. Therefore 
by shifting the integral contour formally, applying the residue formula and 
changing the order of the sum and the integral, we can obtain the formal 

sum Y^jL\djS™ (z,t), where d/s are constants and S^'s are as in (1.1). But 
this sum is not convergent in the usual sense (see §5.6). In order to justify 
this formal computation, we use the idea of the exact WKB method (see e.g. 
[35],[1]). 

Introducing the positive large parameter q, we consider the integral 



1.9) 



ZT 2m v Q 



-F(v)-1 



ip(v) 



-dv 



r™dr, 



where F and T are an appropriate function and contour, respectively. Note 
that when q — 1, this representation reduces to (1.8). The same procedure 

as above yields the convergent sum J2'jLidjSj n (z,t)q~f^~ 1 , where f(j) is as 
in the theorem. Next, we apply the Borel and Laplace transformations to 
the above convergent sum with respect to q in this order, then we can obtain 
the following representation: 



f 

Jo 



-qp 



E 



sr(z,t) P 



dp, 



which is equal to the above convergent sum. Now we regard q as a complex 
variable. Since the sum in the integral has the estimate (1.4), the above 
integral can be analytically continued to q — 1. In fact, the sum in the 
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integral has the estimate (1.4) in the theorem. Hence we obtain the integral 
representation (1.2) in the theorem. 

The estimate (1.4) of the sum H can be obtained by using the idea of E. 
M. Wright [36]. The method of Wright is useful to obtain the asymptotic 
expansion of entire functions which are expressed by Taylor series. 



2 Construction of singular solutions 

In this section we recall M. Christ's construction [6], [7] of singular solutions 
to 5 b u = 0. 

We show that there exist the function F such that B^F is not real analytic 
and B b dlF = 0. We identify M m with C x R as in the Introduction. Let dl 
be the formal adjoint of d b with respect to the Lebesgue measure on C x R. 

In the case of M m = {lmz 2 = [Rez 1 ] 2m } (m e N), d b = X + %Y and 
dl = —X + %Y where 



X = ^- 

dx 



Y dy 



8 

„2m-l u 



2mx zm - 1 — . 
dt 



Applying the partial Fourier transformation in the y and t variables, we seek 
solutions to dbdlu = of the form u(x,y,t) = e ltr e lT]V f (x) . Then Bbd b u = 
reduces to the ordinary differential equation: 



(2.1) 



d 



— r - + (v ~ ^rnTX 2m ~ 1 ) o — + (rj - 2mrx 



d 



„2m-l 



dx 



f{x) = 0. 



We suppose that r > and change the variables by u = r^mx, rj = r^^, 
with (gC. If we set f(x) = g(r^x), then (2.1) reduces to 



L ig (u) :-- 



«(») = o 



Since factors as a product of two first-order operators, one finds an explicit 
solution of L^g^ = 0: 



j-Zu+u 2 



f e~ 2 ^ m '^ds. 

J —CO 
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Here we fix £ G C and define formally 



/■°° — 1 

Fz(z,t)= e ttT e* VT ^ 9i :{T^x)dT. 

J 

Then F$ satisfies BbB^F^ = formally and 

B* b F.(z,t)= e itT e- x T e z ^dr. 
Jo 



If the imaginary part a of £ is positive (resp. negative) and if g% is a 
bounded function on R, then the above two integrals converge absolutely for 
y > ( resp. y < 0). Moreover 



•/ 



2m(ay) 



-2mk—2m 



T(2mk + 2m). 



Thus c^-F^ would not be real analytic and moreover d^F^ would belong to s-th 
order Gevrey class G s for all s > 2m, but no better, where G s = {/ ; 3C > 
Os.t. \d a f\ < C^T(s\a\) Va}. 

From the above, if there exists £ G C, with Im£ 7^ 0, such that 55 is 
bounded on R, we obtain singular solutions of B^u = 0. The following lemma 
gives the condition for g% to be bounded. 

LEMMA 2.1 ([5]) The function g^ is bounded on R if and only if £ G C 
satisfies 

^) = r e - 2 ^ 2m -^w = 0. 

J -co 

Here we remark that the function tp appears in the integral formula of the 
Szego kernel of M m (1.8), which has been computed by A. Nagel [30]. 

As was mentioned in Section 2, the function ip has infinitely many zeros 
and all of them exist on the imaginary axis for m G {2,3, . . .}. Hence we 
obtain non-real analytic solutions, in the range of d£, to B^u = for m G 
{2,3, . . .}. However when m — 1, ip is a Gaussian function and it has no 
zeros, so we can not construct the singular solutions. 
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3 Proofs of Theorems 1.1 and 1.2 



In this section we give the proofs of Theorems 1.1 and 1.2. We suppose 
that m is an integer with m > 2. 



3.1 Proof of Theorem 1.1 

A. Nagel [30] has computed the Szego kernel of M m explicitly. We set 

K(z,t) = S((z,t); (0,0)), then we have 

/•oo -. , 

(3.1) K(z,t)=c e ltT e~ x T P(zr^)r-dT, 

Jo 

with 

(3.2) P{u) = j°° e uv -^—dv, 



3G 



ip(v) 



and 



<P\V) 



/OO 
e-^ w2m -^dw. 
-oo 



From the above formula, in order to investigate the properties of K(z, t), 
the analysis of the function (p seems to be important. Actually the following 
properties of ip in the two lemmas below are very important in our compu- 
tations. From now on we regard the function ip as an entire function on the 
complex plane. Note that <p is an even function and <p(0) > 0. 

The first lemma is concerned with the asymptotic behavior of ip at infinity. 
By f(x) ~ g(x) as x — > oo on a < argx < (3 (a < (3), we mean that 
f(x)/g(x) converges 1 as \x\ — > oo uniformly on a < argx < (3. 

Lemma 3.1 Let A(x) be defined by A(x) = Cox 2 ™-- 1 expjcia; 2 ™- 1 }, where 

1 . 1 . 1 -| 1 / 1 \ 2 m 

c = 7T2 (2m - lj 2 (2m) an d Cl — 2[( ^) 2m - 1 - (i^) 2 " 1 " 1 ]- Then 

IT 3"7T 

(p(x) ~ A(x) + A(xe~ m ), asx^oo on h e < aigx < e, 

where e is an arbitrary constant with < e < | . 
From the above lemma, we have 

7T 7T 

~ A(x), as a; — > 00 on — — + £" < argx < — — e, 
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and 



(p(x) ~ A{xe m ), as x — > oo on — + e < argrr < -ix — e. 

The second lemma is concerned with the distribution of the zeros of tp. 
Since the exponential order of tp is , ty? nas infinitely many zeros. More- 
over, it is known in [33] that all zeros of tp exist on the imaginary axis. The 
asymptotic distribution of the zeros of tp is as follows: 

Lemma 3.2 All but finitely many of zeros of tp are simple. Let {±iaj]0 < 
a,j < aj + i, j G N} be the set of simple zeros of p. Then we have 

j = c 2 a] m - x - - - Jo + OCT 1 ), as j -> oo, 

where c 2 = f [(ak) 5 ^ - (^) 3 ^ T ] ' cos 2^if ^ e Z ts a constant 
depending only on m . 

We denote the set of non-simple zeros of tp by {±ibj]0 < bj < bj +1 ,j = 
1,2, ... , J}, where J > is an integer depending only on m. We expect that 
the above set is empty (i.e. J = 0). 

For the proof of the two lemmas above, we refer to the forthcoming paper 
([25]). 

For the computation below, we prepare the integral contours T±, L± in the 
■y-plane. Set ro = |min{ai,fei}. The contour T + is defined in the following 
way: T + follows the half-line v = re im ^^ from r = oo to r = r , the circle 
v = r e +te from 9 = ^±1^ to 9 = ^zIe anc [ the half-line v = re 2 ^^ from 

u rn 2 m 2 

r = r to r = oo. The contour L + is defined in the following way: L + 
consists of two parts L\, L\, which follow the imaginary axis. L\ follows it 
from v = +ioo to v = iro and L\ from v — iro to v — +ioo, but L\ passes 
left-hand side of each points v = iaj,ibj, while L 2 + right-hand side of them. 
Reflecting the contours Y + , L + with respect to the real axis, we obtain r_, 
L_, respectively. (See Figure 1.) 

Now we define K q (z,t) as follows : 
(3.3) K q {z,t) = c (°° e ttT e- x2mT P q (zT^)r^dT, 

J 
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Figure 1: Integral contours T±, L±. 
12 



with 
(3.4) 

(3.5) 



P q (u 



JF <y(y 



a -F a (y){v)-l 

e- — dv, 



ip(v) 



2m ir 2m 



F±(v) = C2e T ' 2m - 1 2y2m-i — — — C2 



1 

±-v 

i . 



1 

4' 



where a(y) is the sign of y and q is a complex parameter belonging to a 
region on which the integral in (3.4) makes sense. Such a region is given by 
the following lemma. 

Lemma 3.3 There exist positive constants e < 1 an d «o < f su ch that 
P q {u) is a holomorphic function of q in the domain V := {q G C; \q\ > 
1 — Eq and | argg| < a }. 

From now on we suppose that q belongs to V. We remark that q — 1 is 
contained in V and Ki(z,t) = K(z,t). In fact we can deform the integral 
contour R into T + or T_ in (3.4) by Lemma 3.1. 

First we give the proof of the theorem in the case where z is in the sector 
| argz — 1 1 < 2m-i f • By Lemma 3.1, there exists a positive number g such 
that if | argf — f | < then 



,Qo 



F+(v)-l 



(p(v) 



< C exp 



-c\v 



2m 

2m-l C OS ■ 



7T 



2m- 1 



where C, c (> 0) are constants independent of v. Thus we have 



,9o 



F+(v)-l 



(f(v) 



-dv 



,Qo 



■F+(v)-l 



ip(v) 



-dv, 



by Cauchy's theorem. Moreover by the residue formula and Lemma 3.2, we 
have 

OO 1 

(3-6) P go (u) = 2m £ -f7—^q^-\ 

j=l Y \ a j L ) 

for some sequence f(j) such that 

(3.7) fU)=J+3o + 0{j- 1 ) asj^oo, 
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where jo E Z is as in Lemma 3.2. Substituting (3.6) into (3.3) and changing 
the order of the sum and the integral, we have 



(3.8) 

with 
(3.9) 



K^,t) = c^-^S^z,t)^-\ 

j=l Y \ a j l ) 



oo 1 

e itr e -x zm T e <T(y)iajZTtt T v ^ 



where a/s are as in Lemma 3.2. Note that 5J, j G N and v > 0, is a slight 
generalization of the singular solution d£F constructed in Section 2. 

Now we define by H(z, t; p) the Borel transformation of (3.8) with respect 
to q, where 



^ r(f(j) + 1) <p'( aj i) 



S™{z,t)p 



Then we have 



K qo (z,t) = c [°° e-^H(z,t;p)dp. 
Jo 

In the same fashion, we have 

(3.10) KJz,t) = c e- qp H(z,t;p)dp, 

Jo 

for q > g . In fact if q > go, then 



-F(v)-1 


< 


-F(y)-1 


ip(v) 




ip{v) 



in |argt> — 1 1 < Moreover, since the right-hand side of (3.10) extends 
analytically with respect to q to the region {Reg > go} H V, (3.10) is satisfied 
there. If we admit Proposition 3.1 below, then (3.10) is satisfied on the region 
V in the same fashion. 

Proposition 3.1 // | &igz ± || < 2m L _ 1 f ; then there is a positive constant 
C s (z) depending on z such that 



\H(z,t-p)\<C s (z)\p\ 
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In particular, (3.10) is satisfied when q — 1. Hence we have 

PCX) 

K{z, t) = K x (z, t) = c e~ p H(z, t; p)dp. 

Jo 

On the other hand, if z is in the sector | aigz + f | < 2~^T f ' then we can 
also obtain (3.4) by replacing T + with r_, F + (v) with F_(v) and +ia,j with 
— icij in the above argument. 

This completes the proof of Theorem 1.1. □ 



3.2 Proof of Theorem 1.2 

The relation between the Szego kernel of M m and the Bergman kernel 
B((zi,Z2);(wi,W2)) of the domain D m = {lmz 2 > [Re^] 2 " 1 } C C 2 is ob- 
tained in [32], §7 . We define K B (z,t) = B((z,t + ix 2m ); (0,0)). This relation 
and the exact computation of the Szego kernel of M m by Nagel ([30]) yield 

(3.11) K B (z, t)=c I" e itT e- x2mT P(zT^)r 1+ ^dT, 

Jo 

where P is as in (3.2). The difference between (3.1) and (3.11) does not give 
any essential influence on the argument in Subsection 3.1. Therefore if we 
admit Proposition 3.2 below, then we can obtain in the same fashion as in 
Subsection 3.1 

K B (z,t) = c B e- p H B (z,t;p)dp, 
Jo 

with 

1+— 

where f(j) is as in (3.7) and £>■ m is as in (3.9). 

Proposition 3.2 // | argz ± 1 1 < ^nf > ^ en there is a positive constant 
C B (z) depending on z such that 

\H B { Z) t-p)\<C B {z)\p\-\. 

□ 
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4 Proof of Propositions 3.1 and 3.2 

In this section we give the proofs of Propositions 3.1 and 3.2. 
Now we define H v (z,t;p) by 

OO 1 1 

where v > and Sj(z,t) are as in (3.9). Note that H = H™ and H B = 
H 1+ ™. In order to prove the two propositions, it is sufficient to show the 
following: 

Proposition 4.1 If \ aigz ± f | < 2m L _ 1 f , t/ien t/iere is a positive constant 
C v (z) depending on z and v such that 

\H v {z,t-p)\<C\z)\p\-y 

Proof of Proposition First we consider the case where z is in the 

sector |argz - f| < ^f. 

By Cauchy's theorem and the residue formula, 

(4.2) H^, t ;p) = / r , f ,' .. ^Ib,')/^ 



with 



/•OO 1 

•/ o 



where the function F + (£) and the integral contour L + is as in Section 3. 
Define the domains D^, in C by 

Df = { UC ; |a rg « =F \ | < g^f §} and fl< = { C <= C; Re C > -i} 

respectively. Then F± : .D^ — > are biholomorphic functions. Let G± : 
Z\ — > be the inverse functions of F±. Here C±(C) — + i)] -5 ™ - - 

Let A, be the values of F + (iaj) = F-(-iaj) G R for j e N, _Bj the 
values of F + {ibj) = F-(-ibj) for j = 1,2, J. Let A/" be the domain 
{£; |C — A,-| < 5 or |£ — -Bjl < 5}, where 5 > is a sufficiently small number. 
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We define the integral contours L, Mi, Mi, N on Dq in the following way: L 
consists of two parts L l , L 2 , which follow the real axis. L l follows it from oo 
to F(ir ) and L 2 from F(ir ) to oo, but L 1 passes below each points Aj, Bj, 
while L 2 passes above such points. N follows the line Ke( = — \ upwards. 
Mi follows the circle ( = Re l6 from 9 = —9i to 6 = Qi, where cos#i = ^ 
and R > is a large number, with R ^ {Aj,Bj}. M 2 follows the circle 
C = e[e %e — |] from 9 = — | to = |, where e is a small positive number. 
(See Figure 2.) 

By changing the integral variable, we have 

(4.2)= / P v ((;z,t;p)d(, 

J L 



with 



P v ((;z,t;p) (= P(C;p)) = ^-^(C;*,f), 
1 

^7(0)' 

Note that P(C',p) extends analytically with respect to ( to the region {Re( > 
-1} \ ({Aj} j&i U {B^i^j U {C < -\}) for fixed z and p. 



^ V (C,z,t) = — S v (G + (();z,t)G' + (0. 



Lemma 4.1 There are positive numbers a, £0,^0,^0 and eo such that, (i) if 
ReC > —\, |C + \\ > max{t , a\p\ + 1} and ( £ M , then 

(4.3) \P(C,P)\<C(z,v)r-^e-^ r \PrK 

(ii) ifRe( = — \ and \C + \ \ > to or (iii) ifRe( > — \ and |C + || < £o> then 



2m 

■ \p\ 



(4.4) \P((;p)\<C(z) 
Lemma 4.1 (i) implies 

(4.5) / P((;p)d( tends to zero as R — > oc 
whereas Lemma 4.1 (iii) implies 

(4.6) / P((;p)d( tends to zero as £ — > 0. 
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Figure 2: Integral contours L, Mi, M 2 , A/". 
18 



Cauchy's theorem applied to (4. 5), (4. 6) yields 



(4.7) / P((;p)d(= / P((;p)d(. 

JL JN 

Here we divide the right-hand side of (4.7) into two parts: 

(4.8) / P((;p)d( = S 1 (p) + S 2 (p), 

JN 

where 

S 1 (p)=i[ P{-\ + it; p)dt and S 2 {p) =i [ P{-\ + it;p)dt. 
J\t\<t 4 J\t\>to 4 

By Lemma 4.1 (iii), we have 

\Si(p)\ < / \P(-\ + it;p)\dt 
J\t\<t 4 

< C(z)\p\-* I \t\-^dt 

J\t\<t 

(4.9) < C(z)\p\--K 
By Lemma 5.1 (i), we have 

\S 2 (p)\ < f \P(~ + it;p)\dt 
J\t\>t 4 

< C(z,v)\p\~* ( e'H-Ut 

J\t\>t 

(4.10) < C(z,v)\p\-$. 
Putting (4.8), (4.9), (4.10) together, we have 



(4.11) 



\H v (z,t;p)\ 



I P(C,p)d( 

JN 



<C(z)\p\". 



- < 



On the other hand, we consider the case where z is in the sector | arg z + 
1 y| • Replacing +iaj with —iaj, with and G + (() with 



2m- 



G-(C) m the above argument, we can obtain (4.11) in the same fashion. 
This completes the proof of Proposition 4.1. □ 
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5 Proof of lemmas 



In this section we establish the lemmas mentioned previously. We suppose 
that z is in the sector | argz ± \ \ < 9 , where 9 := 2m 1 _ 1 |. We set ( = re 1 



5.1 Proof of Lemma 3.3 

We only give the proof for the case where the integral contour in (3.4) is 
T + . We can prove the lemma in the case of T_ in the same fashion. By 
Lemma 4.1, we obtain 



„uv 



<p(v) 



< C(u) exp j— cir 2 ™- 1 sin# } , 



and 



Q 



-F+(v)-l 



< c\q\ 



-- ( 2m -| 

"4 exp I -c 2 r 2 ™- 1 [cos26> • log \q\ — sin20 o • | argg|J J- , 

to r» ci in T <"i rtrt nrt r» Q 1 ✓->_ in nc in T rvm rtrt o Q O ' I 'Vi nn 



for v € T + , where ci is as in Lemma 3.1, c 2 is as in Lemma 3.2. Then 



q 



,-F+(v)-l 



(p(v) 



< C(u)\q\~ l 



r 2m I 

• exp | — r 2m-i [ Cl sin 6> + C2 cos 2# • log |g| — c 2 sin2# • | arg g | J > . 
Now if we set 

t/ I rP I is / 1 sin ci 1 . f 7T 1 sin c x ' 

V = < q e C ; \q\>exp< — f and argg < mm < -, -— — 

{ { 3 cos 26*0 c 2 J [23 sin 2# c 2 

then we obtain 



uv 



q 



-F+(v)-l 



(p(v) 

Note that < exp{-|^g^} < 1. Since the integrand in (3.4) satisfies 
the above inequality and is a holomorphic function of q on V, we can obtain 
Lemma 3.3. □ 



< C(u)e~ cr 



2m 

2m— 1 T r- 

on I/. 
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5.2 Proof of Lemma 4.1 



In order to prove Lemma 4.1, we prepare the following two lemmas. We 
write P(C;p) = j^-^(C;^), where $»(C;z,t) = ^i(^(G ± (C); z, t) 
G" ± (C)- 

LEMMA 5.1 Let h be a real number. If either (i) Re£ = h or (ii) Re£ > 
anc? r > 6e|p| 6 > 1, then 



(5.1) 



r(C+i) 



< cr-^- h b h " rcose \p\ h exp{r sine ■ 6}. 



Lemma 5.2 There are positive constants r ,p ,eo such that, (i) if Re( > 
~\i ICI > r o an d ( A, then 



(5.2) |$ W (C;^*)I < C(z,v)r~P°exp^-7rr 
and (ii) i/Re£ > — \ and \( + \ \ < e , then 



cos(fl + f - \e\) 

COS 9 



(5.3) 



mC;z,t)\<C(z) 



i 

2m 



By using the above two lemmas, we obtain Lemma 4.1 as follows. 
First we consider the case (i). By Lemma 5.1 (ii), where we put h 



4> 



and Lemma 5.2 (ii), if Re( > — |, |C + f I > max{r + |,6e|p|} {b > 1) and 
C ^ A/", then we have 



\p(C,p)\ = 



l* w (C;*,0l 



r(C + i; 

< c(2,u)r Ha °-*&-*- rc0Be 

r cos(^ + 1 - l^i) 

• exp < — 7rr — 

< C(z,v)r~ f5 °'^ 
■ exp < — r 



COS #0 



+ r sin#-# \-\p\ * 



cos(0 o +|-|0|) 



log 6 • cos# + 7i — ' 2 — — + sin 0-0 

cos 6*o 
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We consider the case 6 > 0. We put p = exp{^^}, then we can obtain 



cos(fl +j-e)_ i 

log • COS + 7T > 

cos#o 



71 



cos^o 2' 



7T/ 1 



for < 6 < % + \{-^r ~ !)■ Therefore if < 9 < - 9 

— — 2 4V cos tf o ' — — 24V cos ( 

have 



— 1), then we 



|-P(C;p)I < C(z,v)r 130 4 expj-r 



1 7T 



(5.4) 



< C(z,v)r 130 4 exp <j — r 



cos 6>o 2 

7T / 1 



4 Vcos^o 



-sin#-# 
- 1 



If -f - f - 1) < < 0, then we obtain the inequality (5.4) in the 
same fashion. Here if we put a = exp{^^ + 1}, ceo = Po + \, to — max{r + 

i t 4tan {i " and K ° = - !). we have ( 4 - 3 ) under the 

condition (i). 

Next we consider the cases (ii), (hi). Since P((;p) is continuous in ( on 
the set {Re£ = — |and£ 7^ — |}, we obtain (4.4) under the condition (ii) by 
(5.1), (5. 3). On the other hand, if we put e = ^(mm{A 1 , Bi\ + |), then we 

obtain (4.4) under the condition (iii). In fact f^yy is continuous in ( on the 

set {ReC > -\, and|C + \\ < e }. □ 



5.3 Proof of Lemma 5.1 

When ReC > h, we have 

1 1 



r(C + i) (27i)-2^ + l 

by Stirling's formula. Hence 



rji + OK" 1 )}. 



r(C+i) 



< cr 2 exp{r cos # log(e|p|r 1 )+rsin9-0} 

= cr~^b~ rcosd ■ exp{r cos# • log(6e|p|r _1 ) + r sin6> ■ 8}. 
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If the condition (i) is satisfied, then 



r(C + i) 



< cr 25 rcose • exp{/ilog(6e|p|r : ) + r sin # • #} 

< cr -§^-'' cos0 |p| ft . ex p{r sinfl • 0}. 
If the condition (ii) is satisfied, then 

r cos 9 log(6e|p|r _1 ) < h log(6e|p|r _1 ), 



and the result follows as before. 



□ 



5.4 Proof of Lemma 5.2 

First we consider the case (i). We define the sectors V± C C x C x R by 



arg£ t 



7T 



2m - 2 vr 

< and 

_ 2m - 1 2 



argz =F 



7T 



< 



1 7T 



2m - 1 2 



We need the following lemma about the behavior of S v (-; z,t) at infinity on 
V±: 

LEMMA 5.3 If z,t) is in the sectors V±, then there is a non-zero constant 
A v (z) G C depending on z and v such that 



(5.5) 

By the above lemma, we have 



lim e nw+2m S v (t;z,t) = A v (z). 



(5.6) 



\S v (t;z,t)\ <C(z,v)\t 



—2mv—2m 



By Lemma 3.1, we have the following: If | arg£| < | and ( ^ J\f, then 



(5.7) 



1 



<P(G±(0) 



< Cr 2m exp < — 7rr 



cos(0„ + |-|0|) 



cos 8 



Since G' ± (() = ±^i[£(C + we have 



(5.8) 



|G±(0I<C 
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If we put Po = (2m — l)v + (2m+ — — |), we have (5.2) under the condition (i) 
by (5.6), (5.7), (5.8). We remark that the above value of (3$ is best possible. 

Next we consider the case (ii). If we put e as in Subsection 5.2, we have 
(5.3) by (5.8) under the condition (ii). In fact [^(G^C))] -1 and S V (G±((); z, t) 
are continuous in ( on the set {(; Re( > ~, and |C + || < ^o}- 1=1 



5.5 Proof of Lemma 5.3 

First we consider the case (£;z,t) G V + . Writing £ = pe ia , with p > 
and | a — || < f^Eyf, and changing the integral variable, we have 

roo „ 1 

S v (£;z,t) = / e ltT e~ x T e^ ZT ^r v dT 
Jo 

/ exp{it^- - x 2m ^- + e ia zu\u 2mv+2m - l du. 
Jo p 2m p 2m J 



p2mv+2rn j Q - - gt. 

Since Re(e ia z) < on V+, 

,2m , 2m 

: x 2 — 

p 2m p. 



roo II II 

/ expiit— - x 2m — + e^zMlM 2 " 1 ^ 2 ™- 1 ^ 

r(2mv + 2m) 

|gi(a— 7r) 2j2m?j+2m 



f°° e e^ Z u u 2mv+2m-l du = T(2mV + 2m) Q 
Jq ' [gi(a— tt) g\2mv+2m ' 



as p — > oo. 

In the case (£; z, i) e VL, we have (5.5) in the same fashion as above. 

□ 



5.6 Divergence of the formal sum in Remark 3) 

If we change the order of the integral and the sum in (1.2) (resp. (1.5)), 
we obtain the formal sum: 

OO 1 

(5.9) c g_s. ( ,, t) , 

where v = — (resp. v — — + 1). Then we have 
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PROPOSITION 5.1 The formal sum (5.9) is not convergent in the usual sense. 

Proof. By Lemma 3.1, we can see that there are j G N and a > 1 such 
that 

> a? 

W[iaj)\ ~ 

for j > jo- Moreover by Lemma 5.3, we have 

\S](z,t)\ > CJ -2™-2m^ 

on | argzi^l < 2 J_i f • By the above two inequalities, we see that the formal 
sum (5.9) is not convergent in the usual sense. □ 



6 Direct proof of Theorem 0.2 

By our representation (1.2), we can directly show that the Szego kernel 
of M m , off the diagonal, fails to be real analytic and moreover it belongs to 
s-th order Gevrey class G s for all s > 2m, but no better. In the case of the 
Bergman kernel of D m , we can obtain the same result in a similar fashion. 
We show that the singularity of the Szego kernel of M m is almost equal 

to that of the function S™ , where 5 1 ™ is the singular solution involving the 
first eigenfunction for L^g = (see §2). Now we suppose that z is in the 
sector |argz — 1 1 < 2 m-i f • By our representation and the residue formula, 
we have 

N-l 1 ± 

(6.1) K(z,t) = c ]T ——Sp(z,t) + R N (z,t). 

j=i V 9 \ia>j) 

Then we have 

Lemma 6.1 There is a positive constant C independent of k such that 

T(2mk + 2m + 2) 



Wk R N (0 + iy,0) 



< C- 



\y\(a N - e)] 2mk + 2m + 2 ' 
where e is an arbitrary constant with < e < a N — a N „ x . 
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By the above lemma and (6.1), we have 



— K(0 + iy, 0) = c—Sf (0 + iy, 0) {l + O (a- k ) } 

as k — > oo, where a > 1 is a constant. Note that 

# i /n . . k T(2mk + 2m + 2) 

Sf (0 + zy, 0) = 2mi k 



dt k 



(\y\a j ) 2mk + 2m + 2 



(see §2). Since S™ does not belong to s-th order Gevrey class G s for s < 2m, 
we can easily obtain 



> c 



T(2mk + 2m + 2) 

(|y|°i) 



2mk+2m+2 ' 



for sufficiently large k G N. We can obtain the same result in the case where 



\aigz + £ < 



1 7T 



2m- 1 2 



£ in the same fashion. 



Proof of Lemma 6.1. By our representation (1.2), we obtain 



q^Rn(0 + 0) = c{-i) k 2mY(2mk + 2m + 2)\y\ 



-2mk-2m-2 ; 



ik,N, 



with 



lk,N 



Jo 



E 



^ „/(■?•) 

2rafc+2m+2^ 



dp. 



Therefore in order to prove Lemma 6.1, it is sufficient to show that 



(6.2) 



I 4,tv | < c(a N - e) 



—2mk 



where e is an arbitrary constant with < e < — a^-i- 

We shall prove the above inequality. By using a similar argument in 
Sections 3,4 and Fubini's theorem, we have 



'fcJV 



c 



h(v)dv. 



Here h(v) = [<f(v)] l v 2mk 2m 2 and the integral contour C consists of three 
parts Li,L 2 ,L 3 : L\ follows the half-line from — oo to 5, L 2 follows the circle 
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Figure 3: Integral contour C. 
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v = 5e ld from 6 = n to 6 = and L3 follows the half- line from 5 to 00, where 
a at— 1 < 5 < <2at and 5 ^ {&?}■ (See Figure 3.) 

Since h is a positive function on L 3 , we have by Schwarz's inequality 



(6.3) < ccT 2mfe . 
Since h is an even function, we have 

(6.4) [ h(v)dv < 



-Amk~Am—A 



dv 



-2mk 



Moreover we have 

h(v)dv 



L 2 



(6.5) 

Therefore we have 



^ ^— 2mk— 2m— 3 

< c5- 2mk . 



w e ~i(2mk+2m+l)8 



de 



J c h(v)dv 



< c5~ 



-2mk 



by (6.3), (6.4), (6.5), so we obtain (6.2). 
This completes the proof of Lemma 6.1. 



□ 



7 Singularities on the diagonal 

In this section we study the boundary behavior of the Szego and Bergman 
kernels of the domain D m := {Ihl2 2 > [Re^] 2 ™} (jn = 2,3,...) on the 
diagonal (i.e. {(z,w);z = w G D m }). Here the Szego kernel S(z,w) of 
the domain D C C n is holomorphic in z, antiholomorphic in w, hermitian 
symmetric and it agrees with the Szego kernel on dD x dD. 

The singularities of the Szego and Bergman kernels at strictly pseudo- 
convex points are studied in detail (e.g. [15], [4]). We are interested in their 
behaviors on the neighborhood of the points on dD m at which the Levi form 
is degenerate. The set of such points is {(z±, z 2 ) G dD m ; Kezi = 0}. On the 
diagonal the singularities of the Szego and Bergman kernels are very similar 
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to those of the domain {£"=1 \zj\ 2m > <1}cC" (m-j e N, j = 1, . . . ,n). The 
detailed explanation is given in [24]. It is important that the singularities 
are expressed clearly by using the polar coordinates (ou,p). 

Proposition 7.1 For the domain D rn = {p{z) :— haz 2 - [Re^i] 2 " 1 > 0} 
(m = 2,3, . . .), the Szego kernel S and the Bergman kernel B take the fol- 
lowing forms: 

b{z,z) = — x ; B{z,z) = — — , 

p(z) m p{z) m 

where u = [Re^i] • [Im^] - ^. Moreover and & B {u) are real analytic 

functions on (— 1, 1) and they have the following estimates: 

where Ci,c 2 are positive constants. 

Remark. From the above proposition, $(u;), $ b (cj) are bounded on the 
region {Im^2 > a[Rezi] 2m } (a > 1), but they are not elsewhere. 

Proof. We write A B to indicate that there are positive constants 
ci, C2 such that ciA < B < c 2 A. 

By [30], [32], the Szego kernel S and the Bergman kernel B of the domain 
D m can be expressed in the following: 



/•oo 1 j 

SYz, 2) =c / e~ br P(aT2^)r™dT; 
Jo 

poo 1 1 

= c / e~ bT P{aT^)T 1+ ™dT, 
Jo 



where a = Re^i, 6 = Ihl2 2 and P is as in (3.2) in Section 3. Now we introduce 
the new variable u = a ■ in the above equations. Then we have 

p\z) m p(z) m 

with r°o , x 

= c[l - cu 2m ] 1+ ™ / e~ s P(a;s^)s-^s; 
j 
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1 f°° 1 1 

$ B (cu) = c[l - uj 2m ] 2+ - / e- s P{us^)s l+ -ds. 

Jo 

In order to estimate the function P, we use a part of Haslinger's results in 
[20]. 

Lemma 7.1 ([20]) Foru > 0, 

P(u)^[l + u 2m ~ 2 ]e u2m . 
From the above lemma, we have 

$H » [l-cu 2 "f + ™ r e -[ 1 - w2m ] s (l + ^ 2m - 2 S 1 -^)^rf S 

JO 

1 , ,2m-2 

= r(i + l) + — ^ r 

m 7 [I-cj 2 " 1 ] 1 ^ 

(7-1) » ^-r — 

[i-kl] - 

In the same fashion, we have 
(7.2) $ B (cu) 1 



[1 — l^l] 1 -^ 

This completes the proof of Proposition 7.1. □ 
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